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The selection of an equilibrium state by maximising the entropy of a system, subject to certain 
constraints, is often powerfully motivated as an exercise in logical inference, a procedure where 
conclusions are reached on the basis of incomplete information. But such a framework can be more 
compelling if it is underpinned by dynamical arguments, and we show how this can be provided by 
stochastic thermodynamics, where an explicit link is made between the production of entropy and the 
stochastic dynamics of a system coupled to an environment. The separation of entropy production 
into three components allows us to select a stationary state by maximising the change, averaged over 
all realisations of the motion, in the principal relaxational or nonadlabatic component, equivalent 
to requiring that this contribution to the entropy production should become time independent for 
all realisations. We show that this recovers the usual equilibrium probability density function (pdf) 
for a conservative system in an isothermal environment, as well as the stationary nonequilibrium 
pdf for a particle confined to a potential under nonisothermal conditions, and a particle subject 
to a constant nonconservative force under isothermal conditions. The two remaining components 
of entropy production account for a recently discussed thermodynamic anomaly between over- and 
underdamped treatments of the dynamics in the nonisothermal stationary state. 


I. INTRODUCTION 

The standard distributions in equilibrium statistical 
mechanics can be derived in an appealingly straightfor¬ 
ward fashion using the principle of maximum entropy or 
MaxEnt. The procedure seems first to have been em¬ 
ployed by Gibbs |T], and was vigorously championed by 
Jaynes [2] as an example of logical inference, namely the 
optimal determination of a statistical description of an 
imperfectly specified system. 

The essential idea is that a system can possess an 
informational entropy that measures the uncertainty of 
an observer’s perception, expressed through a probabil¬ 
ity distribution over all the configurations (microstates) 
that the system could adopt. In order to represent the 
situation in as objectively neutral a fashion as possible, 
so the argument goes, we should select the distribution 
that has the greatest informational entropy, while enforc¬ 
ing consistency with any known properties of the sys¬ 
tem, represented as expectation values over the distri¬ 
bution. For various mathematical and physical reasons 
Ellll, the informational entropy Sj of a probability dis¬ 
tribution p(i) over a set of microstates labelled i is writ¬ 
ten Sj = — liip(j) and if the constraints take the 

form of fixed expectation values (C^) = 
of a set of microstate-dependent quantities Cn, then it 
can be shown by way of the method of Lagrange multi¬ 
pliers that the statistical representation that makes no 
unwarranted further assumptions about the system is 
p{i) oc exp[—A„C'„(i)] where the A„ are constants. 
So if we consider a physical system and employ the con¬ 
straint that it possesses an identifiable mean energy as a 
consequence of being coupled to an isothermal reservoir 
acting as a source and sink of heat, then the optimal rep¬ 
resentation is canonical: p{i) (x exp(—i?(z)/A:Tr), where 
E(i) is the system energy in microstate i, the reservoir 


is characterised by a temperature T^., and k is the Boltz¬ 
mann constant. Such a distribution would clearly repre¬ 
sent a situation with time independent system properties. 

Jaynes argued that similar procedures should be used 
to select probability density functions (pdfs) in more gen¬ 
eral situations, particularly for nonequilibrium stationary 
states El [5]. The general strategy would be to introduce 
constraints relating to the existence of a non-zero flux of 
energy or particles through or within a system and some 
progress along these lines has been made, for example 
in E]. Principles for selecting the most probable path 
taken by a system have a long history mm also reviewed 
in 0 ) and a similar rationale underlies the nonequilib¬ 
rium statistical operator method (NESOM) developed by 
Zubarev and coworkers [Min]. Variational principles 
involving the production rate of entropy in stationary 
states have also been proposed mi as well as the 
maximisation of relative entropy [15] . 

A puzzling aspect of MaxEnt, however, is that the se¬ 
lection of the prevailing constraints appears to be rather 
arbitrary. For example, if a system is exposed to a heat 
reservoir such that an expectation value of energy is iden¬ 
tifiable and therefore relevant to the MaxEnt procedure, 
then why are the expectation values of additional func¬ 
tions of energy not relevant? Why does a term pro¬ 
portional to [E(i)Y' not appear in the exponent of the 
canonical distribution in addition to E(i)7 An argument 
is often made that constraints are placed upon dynami¬ 
cally conserved quantities, which would exclude arbitrary 
functions of energy, but this strongly suggests that dy¬ 
namics must underpin the procedure. It is our aim here 
to demonstrate that the framework of stochastic ther¬ 
modynamics can provide the underlying dynamics in the 
derivation of the MaxEnt principle. 

In Section m] we give a brief overview of stochastic ther¬ 
modynamics, discussing the way in which (stochastic) en- 
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tropy production is both a reflection of the mechanical 
irreversibility of the underlying stochastic dynamics and 
the basis of a measure of the change in microstate-level 
uncertainty of a system with time. We describe how the 
total entropy production may usefully be separated into 
three components, each with a specific character. In Sec¬ 
tion |III| we discuss the dynamics of mean total entropy 
production for a system subject to a conservative force 
held and coupled to an isothermal reservoir, arguing that 
this viewpoint provides a route to the canonical solution 
to the stochastic dynamics, and showing how this maps 
onto the traditional MaxEnt variational principle. We see 
how the constraints on the variational procedure emerge 
as a result of the dynamical coupling of the system to the 
reservoir. Only one of the three components of entropy 
production is non-zero in this case. 

In Section |IV| we consider a nonequilibrium situation 
where a system is exposed to a background temperature 
gradient and show that the stationary state may be se¬ 
lected by the maximisation of the mean relaxational or 
nonadiabatic entropy production, one of the three com¬ 
ponents, or equivalently by requiring the increment in 
this component to be zero for all possible dynamical sce¬ 
narios. We note that the average of the remaining two 
components accounts for a recently discussed anomaly 
in entropy production between over- and underdamped 
treatments nsiin]. Supporting analysis is provided in 
Appendix ^ and a system driven by a nonconservative 
force under isothermal conditions is discussed in Ap¬ 
pendix]^ We give our conclusions in Section ]V| 


II. STOCHASTIC DYNAMICS AND 
THERMODYNAMICS 


Stochastic thermodynamics is based on a set of 
stochastic differential equations (SDEs) that describe the 
evolution of system dynamical variables |18ll2n] , together 
with a definition of the entropy production associated 
with a possible realisation of the motion | 21 lEl] . 

We focus our discussion on the motion in one spatial 
dimension of a single particle coupled to a set of heat 
reservoirs, each corresponding to a given position of the 
particle. The motion is described by the following Ito- 
rules SDEs: 


dx = vdt 

Fix') 

dv = —jvdt H- -dt + 

m 





( 1 ) 

( 2 ) 


where x and v are the particle position and velocity, re¬ 
spectively, t is time, 7 is the friction coefficient, F{x) 
is a spatially dependent force field acting on the parti¬ 
cle, assumed for the moment to be related to a potential 
4>{x), m is the particle mass, Tr{x) is a spatially depen¬ 
dent reservoir temperature and dW is an increment in 
a Wiener process. Such a starting point for discussing 
the stochastic behaviour of a particle in a temperature 


gradient is often employed, though alternatives can also 
be imagined. The simplicity of Eqs. Q and Q is con¬ 
venient for our purpose. 

Given the dynamics, entropy production is defined in 
the fashion proposed by Seifert [23]. It is fundamentally 
a measure of the probabilistic mechanical irreversibility 
of the motion. For a given time interval 0 < t < r, 
the dynamics can generate a trajectory x, v (where x 
represents a function x{t) in the specified time interval) 
according to a probability density function V{x^v\. In 
the situation under consideration, the latter can be writ¬ 
ten as a product of the probability density p{x, v, t) of a 
microstate with x = a:( 0 ) and v = u( 0 ) at t = 0 , and a 
conditional probability density that the specified trajec¬ 
tory is followed thereafter. The dynamics are also capa¬ 
ble of generating an antitrajectory after an inversion of 
the particle velocity at time r, and under the influence 
of a reversed time evolution of the force held and reser¬ 
voir temperature, if relevant E5H53, until a total time 
2r has elapsed. In this period r < t < 2r we can identify 
the probability density V^[x\v^\ that an antitrajectory 
x\v''' starting at x{t),—v{t) and ending at a:( 0 ),—u( 0 ) 
is generated, with the superscript R reminding us that 
the potential and reservoir temperature evolve with time 
in a reverse fashion with respect to the period 0 < t < t. 
The antitrajectory x\v'^ is the ‘time-reversed’ partner 
of x,v |28I[5D] . The total entropy production associated 
with the trajectory x, v is then defined by 


Astot[5, v] = In 


V[x, v] 
V^'[x\v'''] 


(3) 


and after multiplication by Boltzmann’s constant and av¬ 
eraging over all trajectories, this corresponds to the pro¬ 
duction of thermodynamic entropy in the process. In 
a condition of thermal equilibrium, when the dynam¬ 
ics would be expected to generate a trajectory and its 
time-reversed partner with equal likelihood, the entropy 
production associated with all feasible trajectories will 
vanish. 

The entropy production along a trajectory evolves 
stochastically, and for the system dynamics considered 
here an increment in Astot is specified by the Ito-rules 
SDE 

= -d[l„ p(x, t)| - ^ ■< ( ^ ) + -i- 

(4) 

The origin of this expression is described in Appendix 
[a] and elsewhere |231 . The second term is the nega¬ 

tive increment in the kinetic energy of the particle over 
the time interval dt, and the third term is the negative 
increment in its potential energy, both divided by the 
local reservoir temperature. Together, they represent a 
positive increment in the energy of the local reservoir 
(which we may regard as a heat transfer dQr to that 
reservoir) divided by the local temperature. This would 
then correspond to a Clausius-type incremental change 
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dAsres = dQr/kTr{x) in the entropy of the local reser¬ 
voir in the interval of time dt. It is then natural to regard 
the first term in Eq. ffl as the change in the entropy of 
the system (the particle) over this period. Seifert defined 
a stochastic system entropy Sgys = — lnp(a:, v, t) in terms 
of the evolving phase space probability density function 
p generated by the stochastic dynamics [53], such that 
we can write 


dAstot = dAssys + dAs res- (5) 

Since velocity evolves in Eq. (§ under the direct influ¬ 
ence of a stochastic force, the rules of stochastic calculus 
apply when we manipulate increments of a function of v. 
Since we employ Ito rules it would be incorrect to pro¬ 
ceed from Eq. Q by writing d(u^) = 2vdv, which only 
applies under Stratonovich rules. An additional term 
proportional to dt would appear Uni ED. Taking this 
properly into account removes an apparent anomaly in 
dAstot discussed in |32| . 

The evaluation of Astot for a specific realisation of the 
motion requires us to determine the evolution of the pdf 
as well as the system variables x and v: we need to solve 
the Fokker-Planck equation |TB| 


dp _ dJ" dp F dp 
dt ^ dv ^dx m dv' 


( 6 ) 


that corresponds to Eqs. ([Tl and ([^, where = —^vp— 
d{Dyp)/dv is the irreversible probability current, with 
Dv = 'ykTr{x)/m. 

In spite of fluctuations in the total entropy produc¬ 
tion as the particle follows a trajectory, it can be shown 
that the average of this quantity is non-negative, a prop¬ 
erty that arises from an integral fluctuation relation 
|23| . This is regarded as the second law of thermo¬ 
dynamics in this framework, expressed as d(Astot) = 
d(Assys) + d(Asres) > 0 where the angled brackets de¬ 
note an expectation over the pdfs of system coordinates 
at the beginning and end of the incremental time period. 

The entropy production can be separated into a spe¬ 
cific set of components, each with a particular character. 
Initial developments in this direction were provided by 
Van den Broeck and Esposito [551 - 155] and extended by 
Spinney and Ford |28I - I30| . working within a framework 
suggested by Oono and Paniconi [^. The total entropy 
production may be written as three terms |28l l29] 


dAstot = dAsi + dAs2 + dAss, (7) 


with the Asi and As 2 components defined in terms of 
ratios of probabilities that specific trajectories are taken 
by the system. We give particular attention to the first 
component, given by 


Asi[a5, v] = In 


V[x, if] 


( 8 ) 


where x^,v^ represents a reversal of the system trajec¬ 
tory without the inversion of velocity coordinates |29| . 


and the superscript ‘ad’ indicates that ‘adjoint’ dynami¬ 
cal rules are employed to work out the probability of its 
generation. 

Our key point is that a dynamical underpinning of 
the MaxEnt principle can be obtained by considering the 
properties of the Asi component. The approach of the 
pdf under the dynamics towards stationarity is equiva¬ 
lent to a variational principle for its selection expressed 
in terms of Asi. Such a principle holds irrespective of 
whether the stationary state is one of equilibrium, in 
which case As 2 and As 3 are both zero during the evo¬ 
lution, or nonequilibrium such that As 2 and Asa are in 
general non-zero. In both cases dAsi vanishes asymptot¬ 
ically and (Asi) reaches a ceiling. 

Let us substantiate these claims. It was shown in 
[281 [55] that the average values of Asi _3 are related to 
the transient and stationary system pdfs (p and pst, re¬ 
spectively) as follows: 


d{Asi) 

dt 


d{As2} 

dt 

djAss) 

dt 


- f dxdv ^ In 


P 


dxdv -^[ 


Dv 


dxdv 

LJ 


Tir 


p{x,v,t) 
Pst{x,v)_ 
Tir,st 


p 


Pst 


- f dxdv ^ In 

./ dt 


Pstix,-v) 
Pst{x,v) 


> 0 , 


> 0 , 


Pstix, -v) 


(9) 

( 10 ) 

( 11 ) 


where Cpst = 0, and J*''’®* = —^vpst — d{DvPst)/dv is the 
irreversible probability current in the stationary state. 
The positivity of the rate of change of (Asi) and (AS 2 ) 
is here explicit, but is also a consequence of integral fluc¬ 
tuation relations for these two components of entropy 
production [5SII331I57]. Furthermore, the unaveraged in¬ 
crements dAsi and dAss take the form 


dAsi = -d[lnp(a;, v, <)] -I- (i[lnpst(a:, u)], (12) 


and 


dAss = -d[lnpst(x, u)] -I- d[lnpst(a:, -u)], (13) 

making clear the conditions for which they vanish 
{p{x,v,t) = pst{x,v) and pst(a:,u)] = Pstix,-v), respec¬ 
tively), while dAs 2 = dAs^es~d[\iiPst{x, —u)]. The SDEs 
that govern the evolution of Asi _3 for a general Marko¬ 
vian dynamical framework are given in Appendix |A] 

The three contributions to the total entropy produc¬ 
tion can be interpreted as follows. Asi is the principal 
relaxational entropy production associated with the ap¬ 
proach of a system towards a stationary state. Once a 
system is in a stationary state, with p = pst, no further 
increments in Asi take place. This component of entropy 
production, averaged over all possible realisations of the 
motion initiated at t = 0, namely (Asi), increases mono- 
tonically towards a positive constant, since Eq. © indi¬ 
cates that d{Asi)/dt —)■ 0 as p —>■ Pst■ The Asi contribu¬ 
tion was denoted the nonadiabatic entropy production by 
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Esposito and Van den Broeck [331 - 155] and its properties 
were given particular attention by Hatano and Sasa m 

As 3 is also associated with relaxation towards the sta¬ 
tionary state, but in contrast to Asi, its average value 
does not necessarily evolve monotonically with time; 
there is no definite sign attached to d{As 3 )/dt in Eq. 
(111. If the stationary pdf is velocity symmetric, how¬ 
ever, Eq. (131 shows that dAss is identically zero. Since 
a velocity asymmetric stationary pdf is typically associ¬ 
ated with a non-zero mean flux of some kind, and also 
with an underlying breakage of the principle of detailed 
balance in the stochastic dynamics [331155] . this compo¬ 
nent arises in situations where there is a nonequilibrium 
stationary state. It was designated the transient house¬ 
keeping entropy production by Spinney and Ford [28] . 

As 2 is also associated with a nonequilibrium stationary 
state, since a non-zero rate of change of its average over 
all possible realisations of the dynamics requires there to 
be a non-zero current in the stationary state. The 
rate of change of the average As 2 is non-negative [38] . 
but is non-zero in a nonequilibrium stationary state, in 
contrast to the rate of change of the average Asi which 
would then be zero. This is the most distinctive differ¬ 
ence between these two components of entropy produc¬ 
tion. Esposito and Van den Broeck referred to As 2 as 
the adiabatic entropy production (and they considered it 
only in the context of the dynamics of even coordinates 
such as position), and Spinney and Ford, who considered 
odd coordinates such as velocity as well, denoted it the 
generalised housekeeping entropy production. 

Other separations of total entropy production into 
three components are possible m, but the choice em¬ 
ployed here has the advantage that the Asa component 
vanishes in the absence of velocity variables in the dy¬ 
namics, and on average its rate of change in a stationary 
state is also zero. 

As a system approaches stationarity, all three kinds 
of entropy production take place, but in the stationary 
state only As 2 and Asa can potentially receive incre¬ 
ments. The mean total entropy production rate in the 
stationary state is represented by d{As 2 )/dt alone. If 
detailed balance holds, both As 2 and Asa would be zero. 
Our proposal is that the monotonic increase in (Asi) to¬ 
wards a ceiling, or equivalently the vanishing of dAsi 
in the stationary state, underpins MaxEnt for equilib¬ 
rium situations, and offers an extension of the procedure 
to nonequilibrium circumstances. We now explore the 
implications of this viewpoint for isothermal and then 
nonisothermal situations. 


III. SELECTION OF AN EQUILIBRIUM STATE 

If the reservoirs were isothermal {Tr{x) = Tq), then 
irrespective of the initial conditions, the system under 
consideration should relax under the stochastic dynamics 
to an equilibrium state with zero irreversible probability 
current and canonical statistics. Let us examine how this 


works out dynamically and thermodynamically. 

We presume that the contributions dAs 2 and dAs^ are 
zero throughout as a consequence of the associated con¬ 
dition of detailed balance in the dynamics, as suggested 
by the velocity symmetry of the expected canonical pdf. 
This can be checked later. If the change in total entropy 
production is indeed entirely given by dAsi then the to¬ 
tal entropy production satisfies not only the incremental 
representation in terms of system and reservoir contribu¬ 
tions in Eqs. ([^ and ([^, but also the mean behaviour 
represented by Eq. (©• 

We are therefore in a position to write 


rf(Agtot) ^ Q 

dt t-^-oo 


lim = 0. (14) 

dt 


The mean total change in entropy of system plus reservoir 
will increase monotonically until it reaches a ceiling. The 
equilibrium state will be achieved when (Astot) becomes 
time-independent. 


We argue that Eqs. (141 are equivalent to the max¬ 


imisation of a constrained Gibbs system entropy over the 
range of possible pdfs, namely a MaxEnt procedure. The 
maximisation would have its origin in the dynamics, and 
would not arise merely from considerations of logical in¬ 
ference. 

To support this viewpoint, we note that the incremen¬ 
tal transfer of energy dQr to the reservoir, that specifies 
the entropy production dAsres in Eq. ([^, is equal to 
—dAE, the negative of the increment in the change (with 
respect to t = 0) in the energy of the system as it evolves 
over the time interval dt. Since dAs^es = dQr/kTo, we 
can rewrite Eq. ([^ as 

d(Astot) _ d{Assys) 1 d{AE) 


dt 


dt 


kTn dt 


(15) 


Next, we recognise that since Sgys = — Inp is a func¬ 
tion of system coordinates at a specified time t rather 
than a function of a trajectory of coordinates, the average 
(Asgys) over realisations of the dynamics is a difference in 
the expectation of Ssys between the final and initial states. 
That is (Assys) = Ssys(t) — Ssys(O) where the expectations 
(indicated by overbars) are averages over the system pdf; 
thus Ssys(t) = f dxdvp{x,v,t)[—hip(x,v,t)] = Sait), 
the Gibbs informational entropy. For similar reasons, 
(AE) = E{t) — E{0). Equations (14) and (151 tell us 
that the quantity Ssys(t) — E(t)/kTQ increases with time 
and reaches a ceiling as a consequence of the exploration 
of system phase space represented by the stochastic dy¬ 
namics and the evolution of the pdf of the system. 

Since Eq. (151 may be written d{Astot)/dt = 
dSait)/ dt—{kT[)y^dE{t) /dt, the dynamical increase and 
saturation of (Astot), irrespective of the initial pdf, is, we 
argue, equivalent to the functional maximisation of the 
quantity Sq — E/kT^ with respect to the pdf. In other 
words, the equilibrium pdf can also result from imple¬ 
menting the condition 


5 

dpst 


- / Pst In Pst dxdv - A 


PstE dxdv 


= 0 , 


(16) 
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Figure 1. Examples of the time evolution of Asi (continuous 
lines) associated with phase space trajectories taken by a sys¬ 
tem as it relaxes towards a stationary state for a particular 
stochastic process. The dashed line is the average of Asi over 
all possible trajectories, satisfying (Asi) > 0. The stationary 
state is approached as t —> oo and is characterised by the con¬ 
dition d{Asi}/dt = 0 or equivalently the property dAsi = 0 
for all possible realisations, both of which are evident. 


with Lagrange multiplier A = l/fcTg, leading to 
Pst{x, v) = Peq cx exp{—E/kTo) with E = mv^ 12 + 

The canonical distribution can be identified by a con¬ 
strained maximisation of the informational entropy of 
the system. It is significant to observe that the only 
constraint that has to be taken into account involves the 
average of the energy, and that this has its origin in the 
production of entropy in the reservoir brought about by 
the dynamics of energy exchange between reservoir and 
the system. No constraints on other functions of energy 
should be included in the procedure. Furthermore, the 
Lagrange multiplier need not be deduced later on to make 
the result conform to the canonical distribution; its value 
had been fixed when writing down the original stochastic 
dynamical equations. Finally, it is easy to check using 
Eq. (131 that dAss = 0 since Peq{x, v) = Peq(x, —v), and 
because = —jvpeq — {-jkTo/m)dpeq/dv = 0, we can 
deduce from Eq. (10 1 that d{As 2 )/dt = 0. Moreover, 
consideration of Eq. (A 6 l leads to the stronger conclu¬ 
sion dAs 2 = 0, to be shown explicitly in the next section. 

An equivalent demonstration of the emergence of a 
canonical pdf from the dynamics of stochastic entropy 
production is to note that dAstot = dAsi = 0 for all 
possible incremental paths taken by the system when 
in the equilibrium state, from which we conclude that 
—dinPeq ~ dE/kTq = 0 with the equilibrium pdf follow¬ 
ing by integration. The association of dAsi = 0 with the 
property d{Asi)/dt = 0 is illustrated in Figure 

Intuitively, the saturation of Sait) — E{t)/kTq is equiv¬ 
alent to the maximisation of the uncertainty in the joint 
microstate adopted by the system and reservoir, brought 
about by the stochastic dynamics as t —>■ oo. This is a re¬ 
flection of the progressive loss of knowledge of microstate, 
as time elapses, in models where a system is coupled dy¬ 
namically to a coarsely specified environment instead of 


one where the microscopic detail is retained |25| . 


IV. SELECTION OF A NONISOTHERMAL 
STATIONARY STATE 


A. Underdamped dynamics 


It is apparent that Eq. together with the dynam¬ 
ics of Eqs. Q and Q, can provide a framework for 
the time evolution of the total entropy production for a 
system exposed to an environment with a spatially de¬ 
pendent temperature. We have up to now regarded F as 
a conservative force, and this could be generalised to in¬ 
clude a nonconservative component that drives a steady 
spatial flow. We investigate the latter in Appendix[B]but 
in this section we shall restrict the discussion to a conser¬ 
vative force field in order to make contact with a previous 
study of a particle in a nonisothermal environment m- 
The system will adopt a stationary nonequilibrium state 
where non-zero mean energy flows take place between the 
reservoirs at each spatial position, by way of the system, 
such that there will be a non-zero irreversible current 
jir,st stationary state, bringing about a steady 

rate of mean total entropy production. In the absence of 
a nonconservative force we would expect the mean veloc¬ 
ity in the stationary state to vanish for all x. 

We could identify the stationary pdf of such a sys¬ 
tem by solving the appropriate Fokker-Planck equation, 
but there is an alternative entropy-based approach. The 
dynamics generate a stationary pdf that embodies maxi¬ 
mum uncertainty at the microstate level consistent with 
the nonisothermal constraints. The physical interpreta¬ 
tion is that the component of mean entropy production 
associated with relaxation evolves to become as large as 
possible. 

Our strategy is to establish an expression for dAsi and 
set it equal to zero for all dynamical scenarios, a condition 
equivalent to p = Pst and hence through Eq. ([^ to the 
reaching of a ceiling in the mean value of Asi. Using the 
general results in Appendix for the dynamics under 
consideration, we can write 


uy,, 

2kTrj 
m 

where ^ is a component of a convenient, but still 
general, specification of the stationary pdf, namely 
Pstix,v) = Pstix)[l + tj}{x,v)]f{x,v) where f{x,v) = 
(TO/27rA:Tr)^/^ exp( —mv'^/2kTr) is a local canonical dis¬ 
tribution, and Pst = / dvpst- Note that if ■)/; = 0 we have 
a canonical distribution over velocity and dAs 2 vanishes 
as claimed in the previous section. 

We also write 


1/2 


dW, (17) 


dAs2 = 


kTr^ / i91n[l -|- 'il){x, - 


m 




dv 


c}ln[l -I- -tplx, —u)] 
dv 


dAss = —(iln[l -|- ip{x, u)] -I- dln[l -|- tjj{x, —'i')], (18) 
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and using dAsi = dAstot ~ dAs 2 — dAss we have 

dAsi = -dlnPst - din/ - —d ( ) 

F 

+ ——dx — dAs 2 — d\D[\ + 'ip{x,—v)], (19) 
klr 

and this reduces to 


mv 


dAsi = -dlnPst + I 1 - 1 + -^dx 

^ A. v* l\j J. y* 


TL 


F 


kTr 

kTr^ / 9 ln[l + tp{x, —w)] 
m \ dv 

31n[l + ip{x, —u)] 


dt 


dx 


dx 

(91n[l + —u)] 

dv 

d"^ ln[l + ' 0 (a;, —z;)] kTr^ 


F' 

— 7 n H- ] dt 

m ' 


dv^ 


dt. 


m 


( 20 ) 


where = dT^/dx. 

Setting dAsi = 0 corresponds to a general condi¬ 
tion for the structure of tp and hence the pdf in the 
stationary state. For illustration, however, we proceed 
with an assumption that ip is small and inversely pro¬ 
portional to 7 , which is the commonly used perturba¬ 
tive Chapman-Enskog representation mi na, a well- 
established approach to solving problems in kinetic the¬ 
ory mi to first order in inverse friction coefficient. This 
is not the same as making an assumption of overdamped 
dynamics, which would involve a different specification 
of the underlying stochastic dynamics. We shall consider 
such an approach in Section [iVB[ We identify the lead¬ 
ing contributions to dAsi, namely those of order 7 ° and 
write 


dAsi = —dlnPst +1 — 77^ TTT^dx + —^dx 


T' 


F 


kTr J 2T, 


kTr 


- AfcFWl* + oh->). (21) 


dv 


dv"^ 


For the right hand side to vanish term by term we deduce 
that a polynomial representation of /’(x, —v) can only 
contain linear and cubic terms in v. We write tp{x,v) = 
av -|- cv^ and require contributions to dAsi proportional 
to v^dx to vanish by demanding that 


from which we conclude that 

dipjx, -v) ^ TP f rr^ 2\ 

dv 2"fTr \ kTr ) ’ 

and 

d'^ip{x, —v) mTp 

dv"^ jkT^^' 

giving 


(24) 


(25) 


dAsi =-dlnPst + ^^dx -’^dx + Oij ^). (26) 

riy J. 7 ^ T 


We deduce that the spatial part of the stationary pdf, to 
lowest order in 7 “^, is 


Pst oc Tr ^ exp 



(27) 


and the selection procedure is complete, with the result 

„2 r p 


1 -k 


Pst oc Ir “'“exp 

T' 


mv 

2kTr 


-k 


X 


2jTr 


m 

V - V 

3kT 


kT, 

3 


-dx 


(28) 


The solution of the appropriate Fokker-Planck equation 
to first order in 7 “^ should, of course, produce the same 
outcome |40| . but our purpose here is to demonstrate 
that it can emerge also from considerations of entropy 
production. 

We now examine the mean production of As 2 ) writing 


Tir,st 

Pst 


= —"fv ■ 


kTr'f dpst kTr^ d ln(l -|- ip) 


mpst dv 


dv 


and employing Eq. (10 1 we obtain 

d{As2) 


dt 


= / dxdvp 


kTrj fd\n[\ + ip{x,—v)] 


y 


dv 


(29) 


(30) 


which is consistent with a direct averaging of Eq. (17l. 
Inserting Eq. (23) we find that 




dt 


m \ 2^Tr 


2 r n 2 

1 W 2 

kTr 


, (31) 


—- —dx — Scv’^jdx = 0. (22) 

kTr 2Tr ^ ^ 

so that c = —mTp/{6jkTr ). 

We consider a situation where the particle is spa¬ 
tially confined by the potential, in the sense that the 
pdf vanishes as x iLoo. This implies the physical re¬ 
quirement that the mean velocity vpst(x, v)dv at a 
given X is zero in the stationary state, equivalent to the 
condition J_^vf{x,v)ip{x,v)dv = 0 . This means that 
a + ickTr/m = 0 and hence to lowest order in 7 “^, 


to lowest order in 7 ^ and in the stationary state we 
therefore have 


d{As2)s 

dt 


= / dx Pst 


kTL- 


‘ 2m'yTr 


+ 0 ( 7 -^). (32) 


Similarly, Eq. (11) gives 

d(As 3 ) 


dt 

which leads to 


= — [ dxdv ^ In 

./ dt 


1 + ip{a 


_1 -k ip{x,-v)_ 


(33) 


ip{x,v) 


2jTr \ 3kTr 


(23) 


djAss) 

dt 


'dxdvp^ 

dt 


T' 

r 

1 % 



3kTr J 


(34) 
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This clearly vanishes in the stationary state, and for p 
close to stationarity in the velocity coordinate (in the 
sense that p/P = / + 0 ( 7 “^), where P{x,t) = f pdv), 
the mean rate of prodnction d{As 3 )/dt is of order 7 “^. 
Note that the stationary solution to the dynamics 


(281 satisfies a local equipartition condition J dv v^pst = 
but that this relationship is valid only to first 
order in 7 “^, in contrast to the approach of |44| where 
such a condition is taken to be a requirement to all or¬ 
ders. Under the dynamics assumed here, the system is 
maintained away from exact local equipartition through 
the flows of heat between the various local reservoirs. 


B. Overdamped dynamics 

It is instructive to consider next the variational identi¬ 
fication of the stationary state under nonisothermal con¬ 
ditions within a framework of overdamped dynamics, and 
to contrast the outcome with the analysis in Section [I V A| 
for underdamped dynamics. The revised dynamics will 
affect the form of each component of entropy produc¬ 
tion, although it remains the case that the principal re- 
laxational component will increase on average until the 
stationary state is reached. 

It is well known [m Uni 05] that Eqs. Q and ([^ 
reduce for large 7 to the Ito-rules SDE for the position 
coordinate: 


7727 


2kTr{x)V/‘^ 


7777 


dW, 


(35) 


together with an associated Fokker-Planck equation for 
the positional pdf P°^{x,t). We investigate the entropy 
production implied by these dynamics, focussing atten¬ 
tion on As°‘^ where the superscript ‘od’ indicates that it 
is associated with the overdamped dynamics. 

For an Itb-rules SDE dx = A°/{x)dt+[2Df{x)]'^^'^dW, 
Eq. (A41 in Appendix [Ajimplies total entropy production 
given by 


dAs?^, = -dlnP°’^ 


Af , dAf , 1 dDf , 

-^dx -I- :^dt -j , dx 

D°^ dx D°‘^ dx 


Af dDf d'^Df 1 

- r^dt-\ -j 

D°‘^ dx dx^ D°‘^ 


dPf 

dx 


dt. 


(36) 


recognising that the rules of stochastic calculus now asso¬ 
ciated with the variable x differ from those that hold for 
the full dynamics of Eqs. 0 and 0 since x evolves in 
Eq. (351 under the direct influence of a stochastic term. 
Inserting = Fjm'y and = kTr/m'^ we 

And that 


dAs°t, = -d\nP°<^ 


F 

kTr 


dx 


FT' kT" 

.AA^dt-^dt 

m^Tr my 


F' T' 

- dt - -dx 

my Tr 

kT'-^ 

- -^dt, (37) 

mjl 


where F' = dF/dx and T" = d'^T^/dx^. Since un¬ 
der Ito rules we have d [/ FTF^dx\ = FT^^dx + 


{F'Tf^ - FTF^T^)dt and dlnT,. = T^^A^dx + 
D%‘^{d\TF^T^]/dx)dt this reduces to 


dAslt^ = -d\nP°^ -d\nTr + \d 

rv 


FTF^dx 


(38) 


Since velocity coordinates are absent in the overdamped 
dynamics there are no contributions and the con¬ 

finement of the particle to a potential such that there 
is no spatial current in the stationary state would sug¬ 
gest that dAs^'^ is zero as well. The observation that the 
overdamped dynamics miss out the housekeeping entropy 
production in the stationary state is the origin of an en¬ 
tropy anomaly [isiini between treatments based on over- 
and underdamped dynamics, to be discussed shortly. 

If the only non-zero contribution to dAs°^f. is dAs°‘^, 
then the stationary state is specified by dAs°^^ = 0. From 
Eq. (38 1 we can therefore deduce the form of P°^^ to be 


nf(a;)cxT, 


-1 


exp / {F/kTr)dx^ 


(39) 


which may be confirmed as the stationary solution to the 
Fokker-Planck equation 


^pod ^ Q /ppodX g2 


dt 


dx \ my 


<«) 


for the overdamped dynamics (35). We note that P°^ is 
consistent with the pdf in Eq. (28 1 obtained to 0 ( 7 “^) 
using underdamped dynamics, when integrated over v. 
This result allows us to check the assertion that dAs^'^ 


vanishes. According to Eq. (A 6 I we write 


..A od ^ dp°‘^ ^ 

dAso° = ^^Tjdx -\ - ;—dx 


pod 

1 

PA dx 


dx 


^dA’^ dPf , 

-2-A - ^dt 

dx dx 


dx 

1 fdP^ 

\ dx 


dt + PA 


V dx 


■A 


od' 


dx 


A°/ dPf 
dt - -pAh—^dt, 
PA dx 


dt 


(41) 


where (p°‘^ = — lnPg°'^. Clearly we have dtf°^/dx = 
T'^/Tr — F/kTr and by inserting the appropriate and 
Pf it follows that dAsf = 0. 

It is possible to construct a MaxEnt principle for the 
selection of PA ^ in the form of a functional maximisa¬ 
tion, from Eq. (38 1 together with dAs^t = dAsA and 


d{AsA)/dt > 0, namely 


SPA 


- / pA In PA dx - / PA In T, dx 


PsAA) 


dx 


, FA') 

kTrix') 


dx 


= 0 , 


(42) 


which is equivalent to the requirement that Sq — In -|- 
f dx F{x)/kTr{x) should be maximised. The system in¬ 
formational entropy SA is a functional of P°‘^, in con¬ 
trast to the more general form Sg given in terms of p. 












































The second and third terms in Eq. (421 are effective 


constraints on the maximisation of system entropy for 
the selection of the stationary P°^ within a framework 
of overdamped dynamics, and they are unambiguons, if 
more elaborate than the constraint that appears in the 
corresponding isothermal case. They have their origin 
in contributions to the total entropy production in the 
reservoirs. While demonstrating a connection with the 
MaxEnt approach employed under isothermal conditions, 
such a functional maximisation would perhaps not be 
the most natural approach to use to select the pdf un¬ 
der nonisothermal conditions. Furthermore, it has been 
derived only for overdamped dynamics. The better strat¬ 
egy would be to focus on the condition for zero increment 
in Asi, namely Eq. (20l. 


Let us now reflect on the differences in the thermo¬ 
dynamics that emerge when we use overdamped rather 
than underdamped dynamics. As already mentioned, a 
treatment using overdamped dynamics fails to capture 
the housekeeping entropy production that is expected to 
take place in a nonisothermal stationary state. For a 
system with an approximately stationary velocity distri¬ 
bution, such that p/p « /{l + ip) = Pst/Pst we have seen 
that the mean contribution d{As 3 )/dt is second order in 
7 “^, and in the same circumstances we can combine Eqs. 
0 . @ and ( |31[ ) to write 


rf(Astot) f, dP 
dt / dt 


'P{x, t) 

+ [ 

.Pstix) _ 

7 


kT'- 


2m^Tj 


+ 0 ( 7 -^) 


(43) 

Replacing P in the second term by Pst, an approximation 
valid if the system is close to stationarity, and inserting 
As°d = Asf, we arrive at 


d(Astot) rf(As°^t) 


dt 


dt 


dx Pstix) 


kT'- 


2mjTr 


+ 0 ( 7 -^). 


(44) 

This is the one dimensional version of a similar result in 
|16| that highlighted an anomaly in mean entropy pro¬ 
duction between over- and underdamped treatments of 
the dynamics of a system. It is clear from our analysis 
that the additional term on the right hand side of Eq. 

(441 is an approximate form of the mean housekeeping 
entropy production that is captured by the underdamped 
treatment but neglected when an overdamped dynamical 
model is adopted. A rational basis for the difference is 
to be found in recognising that entropy production is a 
consequence of the dynamics, and that modifications in 
the construction of the equations of motion will introduce 
changes in the form of the entropy production. The iden¬ 
tification of the anomaly as a mean housekeeping entropy 
production (to lowest order in 7 “^) using the analysis 
presented here gives it a clear physical interpretation. 


V. CONCLUSIONS 

A framework of stochastic thermodynamics [24] pro¬ 
vides a direct connection between entropy production 
and a stochastic model of the trajectory-level dynam¬ 
ics of a system. This dynamical connection has brought 
clarity to the concept of entropy production in statistical 
physics, enabling it to be extended to individual realisa¬ 
tions of the evolution of a system and situations where 
fluctuations are important. A description of the mean en¬ 
tropy production can emerge from a treatment of the dy¬ 
namics at the level of a Fokker-Planck equation, namely 
the behaviour of the system probability density function, 
but stochastic thermodynamics adds a crucial specifica¬ 
tion of the entropy production in terms of the probabil¬ 
ities that certain trajectories might be generated. We 
can separate the total production of entropy into three 
components within this framework. 

The MaxEnt procedure for selecting equilibrium prob¬ 
ability density functions has strong credentials as an ex¬ 
ercise in logical inference, but we argue that it is made 
more compelling by demonstrating that it can arise nat¬ 
urally as a result of the underlying stochastic dynamics. 
The central question of how to constrain the maximisa¬ 
tion of the system informational entropy is resolved by 
noting that the constraint terms employed in the deriva¬ 
tion of the canonical pdf can be related to the mean en¬ 
tropy production in the environment. Constraints are 
therefore associated with the dynamical couplings of the 
system to the environment, and these often arise through 
the exchange of dynamically conserved quantities. The 
underlying principle of MaxEnt is to maximise the uncer¬ 
tainty in our perception of the microscopic state of the 
world. This is underpinned by the monotonic increase 
and saturation of the mean total entropy production at 
equilibrium according to the dynamics. 

Such a framework can be extended to the selection of 
stationary pdfs for nonequilibrium systems. It is a ther¬ 
modynamic alternative to seeking a time-independent 
solution to the appropriate Fokker-Planck equation de¬ 
scribing the dynamics. The average of the principal re- 
laxational, or nonadiabatic component of entropy pro¬ 
duction Asi IMIIM1I33 increases to a ceiling when the 
stationary state is reached, and increments in this compo¬ 
nent thereafter vanish. By exploiting the latter property 
the nonequilibrium pdf can be identified. We have im¬ 
plemented such a strategy in a simple one dimensional 
system of trapped Brownian motion in a thermal gra¬ 
dient using both under- and overdamped dynamics. In 
doing so we recover the ‘anomaly’ between the entropy 
production obtained under the two treatments m and 
show that it corresponds to housekeeping entropy pro¬ 
duction. We have also used the strategy, in Appendix |B] 
to recover the known stationary pdf for a particle sub¬ 
jected to a constant nonconservative force and isothermal 
conditions. 

In summary, the principal insight presented in this pa¬ 
per is that the stochastic dynamics of a system generate 
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stationary statistics in a fashion that maximises the mean 
of a certain component of entropy production, Asi, and 
that this can map onto the procedure of constrained max¬ 
imisation of system informational entropy based on logi¬ 
cal inference. The procedure is equivalent to demanding 
that the increment dAsi brought about by the dynam¬ 
ics should vanish for all possible trajectories. We have 
employed this approach to select an equilibrium state of 
a system in an isothermal environment and a nonequi¬ 
librium state under nonisothermal conditions. We also 
consider an isothermal system subject to a nonconserva¬ 
tive force. The dAsi = 0 condition is equivalent through 
Eq. (12) merely to the requirement that the pdf is sta¬ 
tionary, but since we can associate the evolution of Asi 
with energy exchange with an environment and associ¬ 
ated system change during relaxation, it has a physical 
interpretation m- Asi is defined in Eq. ^ in terms 
of probabilities of system evolution at the level of trajec¬ 
tories, one of the foundational statements of stochastic 
thermodynamics, from which the property (Asi) > 0 
follows, and an algorithm for the maximisation of (Asi) 
is provided by the underlying system dynamics. We sug¬ 
gest that the procedure provides a natural extension of 
canonical MaxEnt to nonequilibrium situations, at least 
for systems governed by Markovian stochastic dynamics. 
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Appendix A: Components of stochastic entropy 
production 

We summarise the main results concerning the dynam¬ 
ics of components of stochastic entropy production that 
are derived in more detail in Spinney and Ford |29| . For 
a system governed by Ito-rules Markovian stochastic dif¬ 
ferential equations (SDEs) 


dxi = Ai{x, t)dt -\- Bi{x, t)dWi, (Al) 

where x represents a set of dynamical variables 
(xi, X 2 , • • •) such as (x, v), we define 

A"'(x,t) = ^ [Ai{x,t) +eiAi{ex,t)] = eiA-"'(ex, t), (A2) 
= h [A,{x,t) - e,A,{ex,t)] = -eiA™''(ex, t), 

where = 1 for variables x^ with even parity under time 
reversal symmetry (for example position x) and Si = —1 
for variables with odd parity (for example velocity v), and 
ex represents (eixi, £ 2 X 2 , • • •). Defining also Di{x,t) = 


^Bi{x,t)^, it may be shown that the following Ito-rules 
SDE for the total entropy production emerges: 


dAstot = -d\np -I- ^ 

i 

dAT'^ 


^dx, - ^ ^ dt+^ 

Di Di dxi 


dt 


5x, D, dxi ^ D, dx. 


dxj 


dt 


1 

A 


dP, 

dxi 


dt 


(A4) 


where p is the time dependent pdf of variables x. The 
corresponding Ito SDE for the principal relaxational en¬ 
tropy production is 

dAsi = —d Inp -I- 

i 


dx.j - D^-^dt 
axd axj 


(AS) 


where p = — Inpst and psi is the stationary pdf. Also 

dAs2 = ^ 


^ir^rev ^ir 

- ' " dt + j^dxi + eip[{ex)dxi 

J-yi -Lyi 


dD 

-2sM{ex)^dt + £.(A- - Ar)^'(ex)dt 


(Af - Ar) dP, 

Pi dxi 


dt 


(A6) 


specifies an increment in As 2 , using notation pt{ex) = 
eidp[ex)/dxi and 

dAs 3 = -dlnpst(x) -I- dlnpst(£x) 

= ° “ £i'^i(£x) o dxi], (A7) 


defines the third component. Stratonovich notation is 
used in the second line for reasons of compactness, but a 
more elaborate Ito-rules version can be constructed. 

For the dynamics specified by Eqs. Q and ([^ we have 
A^-- = 0, A^®'' = V, A^i = --fv, A™'' = F/m, P^^ = 0 and 
Py = kTy^/m and using Eq. (A4) we recover Eq. 


Appendix B: Particle in a nonconservative force field 

We consider how the stationary pdf of a particle evolv¬ 
ing according to Eqs. Q and ([^ with a nonconservative 
constant force field F(x) = Fq and an isothermal envi¬ 
ronment Tr{x) = Tq can be selected according to the 
condition that (Asi) should be maximised. As before, 
we regard this as synonymous with dAsi — 0 . 

By adapting Eq. ( [20| , while demanding on phys¬ 
ical grounds that the pdf should be spatially inde¬ 
pendent, we replace ln[l - 1 - 'ijj{x,v)] by h{—v) and 
write Pstiv) = Pst exp[/i(-n)]/(n) with f{v) = 
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[m/(27rfcro)]^/^ exp[—mti^/(2fcTo)]. The function h is 
specified by 

-^0 kT^l (fit 


dAsi = TTfrdx - . , 

kIq m \dv J 

-f (--,«+^)dt-'A'^dt = 0. (Bl) 
av \ m J av^ m 

and the normalisation f dv exp[h{—v)]f{v) = 1. It is ap¬ 
parent that a quadratic in v is the highest finite polyno¬ 
mial form that h can take (the exponent N in the leading 
term must be even to preserve the normalisation but 
N > 2 would produce a non-vanishing term proportional 
to and hence we write h{ v) = oq -I- aiv + a 2 V^. 

The condition that terms in Eq. (Bll proportional to 
v^dt vanish is 


corresponding to 


Pst(f) (X exp - 


m[v - Eo/(to 7 )]^ 
2kTn 


(B4) 


which is the known stationary state for such a system 
|29| . Adapting Eqs. ( [T7| and (181 we identify the incre¬ 
ments in the remaining components of entropy produc¬ 
tion to be 


dAso = 


p 2 

-^0 


dv) 

dt - ^ 

ov 

m 

dt 

f 2F2 ^ 

1/2 

1 dW, 

\jmkToj 


dW 


(B5) 


— {kTQj/m)4:a2 + 2a2j = 0, (B2) and 


with solutions 02 = 0 or m/{2kTr), but the normalisation 
condition eliminates the second option. The condition 
for terms in both vdt and dt to vanish is found to be 
ai = —FoK-ykTo), and the normalised pdf is therefore 
specified by 


h{v) 


Fqv 

2m'y'^kTQ jkTo ’ 


(B3) 


dAss = —dh{—v) + dh{v) 


2 Eo ^ 
jmkTo^^' 


(B6) 


which do not vanish, even in the stationary state, un¬ 
less Fq = 0. Distributions of the components of entropy 
production in a relaxation process for this system were 
examined in |29| . 
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